Papers with Top-1 accuracy
Weakly supervised hierarchical multi-task classification of customer questions (2023.acl-industry)
Copied to clipboard
Jitenkumar Rana, Promod Yenigalla, Chetan Aggarwal, Sandeep Sricharan Mukku, Manan Soni, Rashmi Patange
| Challenge: | Identifying granular and actionable topics from customer questions helps improve the overall customer experience. |
| Approach: | They propose a weakly supervised Hierarchical Multi-task Classification Framework to identify granular topics from customer questions . a clustering based taxonomy creation and data labeling module is used to create taxonomies and labelled data with minimal supervision. |
| Outcome: | The proposed model achieves 13% better accuracy over single-task classification frameworks . it can adapt to constantly evolving taxonomy without need of re-training . |
DeAR: Dual-Stage Document Reranking with Reasoning Agents via LLM Distillation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | DeAR is an open-source framework that decouples the tasks of LLMs with holistic cross-document analysis. |
| Approach: | They propose an open-source framework that decouples relevance scoring with holistic cross-document analysis. |
| Outcome: | The proposed framework outperforms open-source frameworks in QA and open-domain QA. |
G3: Geolocation via Guidebook Grounding (2022.findings-emnlp)
Copied to clipboard
| Challenge: | a new task uses explicit knowledge from human-written guidebooks to improve geolocation accuracy . a state-of-the-art image-only method is unable to predict the location of an image . |
| Approach: | They propose a task that uses streetview images and a guidebook to predict a country for each image . they add clues from the guidebook and supervise attention with country-level pseudo labels . |
| Outcome: | The proposed method outperforms state-of-the-art image-only geolocation methods with 5% improvement in Top-1 accuracy. |
Improving Zero-shot LLM Re-Ranker with Risk Minimization (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are effective Query Likelihood Models, but their estimation is biased and the model's accuracy is poor. |
| Approach: | They propose a framework which leverages Bayesian decision theory to quantify and mitigate this bias. |
| Outcome: | The proposed framework improves re-ranking, especially in improving the Top-1 accuracy. |
Improving Occupational ISCO Classification of Multilingual Swiss Job Postings with LLM-Refined Training Data (2025.findings-acl)
Copied to clipboard
| Challenge: | 80% of job postings are German, 11% French, 8% English, and under 1% Italian. |
| Approach: | They propose a method that refines silver-standard ISCO labels by consolidating them with predictions from pre-fine-tuned models to resolve discrepancies. |
| Outcome: | The proposed method raises Top-1 accuracy on silver data to 58.3% and reaches 80% precision on held-out data. |
Privacy Risks of Intermediate Representations: Attribute Inference in Distributed LLM Inference (2026.findings-acl)
Copied to clipboard
| Challenge: | Distributed LLMs avoid raw inputs by transmitting intermediate hidden states, a practice widely assumed to preserve privacy. |
| Approach: | They propose a distributed inference framework that transmits intermediate hidden states to avoid sending raw inputs by exposing sensitive user attributes. |
| Outcome: | The proposed approach achieves Top-1 accuracy of 0.997 on CMS, 0.980 on Skytrax, and 0.986 on ECHR. |
R3: End-to-End Reasoning-based Planning for Multi-step Retrosynthesis via Reinforcement Learning (2026.acl-long)
Copied to clipboard
YiFei Wang, Qizhi Pei, Jiangtao Feng, Yuntian Shi, Yi Duan, Lihao Wang, Lei Bai, Lijun Wu, Wei-Ying Ma, Hao Zhou
| Challenge: | Experimental results show that R3 is a superior alternative to traditional search algorithms for multistep retrosynthesis planning. |
| Approach: | They propose a framework that reformulates multistep retrosynthetic planning as a generative reasoning task. |
| Outcome: | The proposed framework achieves state-of-the-art Top-1 accuracy of 43.7% on retrobench . it leverages Large Language Models to reformulate multistep retrosynthesis as a generative reasoning task. |